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^ ! Abstract 

■ We find the free-energy in the thermodynamic limit of a one dimensional XY model 
associated to a system of N qubits. The coupling among the erf is a long range two 

■ bodies random interaction. The randomness in the couplings is the typical interaction 
of the Hopficld model with p patterns (p << N) , with the patterns being a p sequences 
of independent identically distributed (i.i.d.) random variables assuming values ±1 with 

r*j | probability 1/2. We show also that in the case p < aN the free-energy is asymptotically 

£Lt independent from the choice of the patterns, i.e. it is self-averaging. The Hamiltonian is 

^ fLi the one used by [4 in his experiment. 
> ■ 

1 Introduction and main results 

. The research on quantum computers has found many algorithms and most of them have been 

implemented on real quantum systems, like for example the Grover's algorithm [T], or the 
quantum Fourier transform [2]. The increase of the technology used in realizing quantum 

■ computers [3] , has convinced a group of physicists to try to implement a quantum neural 
network [3]. In their experiment they treat a system of two q-bits with Hebbian interaction 

7— I " generated by one pattern with random entries ±1 : 

o: 

(N- i v 

> ■ m=i 

where }j=i ... jv,u=l,...p is a system of i.i.d. random variables, £f = ±1 with probability 
i. Thus it is a model of the type introduced by Hopfield [5j but the spins are quantum 
objects instead of the classical Hopfield model. They used two q-bits of a NMR quantum 
computers to which they applied the Quantum Adiabatic Computation (QAC) [6] for building 
the two q-bit state and they found the retrieval states imposing some input Hamiltonian. The 
retrieval states were constructed with Quantum Annealing [7] and they were the minima of the 
Hamiltonian . This is the first example of implementation of a neural network of the Hopfield 
type with quantum spins. There have been other proposal of quantum neural networks [8] 
but we think that the system built in [3] is more adequate to the function of retrieval and 
storage typical of the neural networks. The problem is that the retrieval and storage in 
classical neural networks is connected with the self-averaging of the free-energy |9j and of the 
overlap parameters, i.e. the network stores and retrieves any kind of information which is 
translated in the formalism as a retrieval for almost all patterns. In the classical model this 
result is obtained only in the thermodynamic limit N — > oo and also in the quantum case 
there is a similar problem. The necessity of large values of N arises from the application 
of probability estimates and from the extension of the law of large numbers which is largely 
applied in the classical case. We are aware of the fact that this limit is far beyond the actual 
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possibilities of the experiments but nevertheless we think that it is important to establish all 
the useful concepts and theoretical results. So in this work we treat the question of the self- 
averaging of the free-energy of a one dimensional system of q-bits with Hebbian interaction and 
independent identically distributed random patterns with values ±1 with equal probability. 
We compute also the free-energy and find the phase transition and the index for the critical 
temperature . The system is described by a Hamiltonian of the type considered in [3], so it 
is the XY model in the one dimensional case with Hebbian long range interaction, and with 
the perturbation of the QAC term: 



1 JV N N 

H = - 2 E •v/"; - E w - E d <> (i- 2 ) 

i,j=l i=l i=l 

where 

*=(;;)■ (-) 

This Hamiltonian has been considered also in other papers like for example |1U| and is the 
usual Hamiltonian for performing quantum measurements. The term multiplying af is the 
one used in QAC for constructing the interesting quantum states, its presence is fundamental 
for the phenomenology of the system. If d = this sytem is the usual Hopfield network 
which has been solved already in with the non rigorous replica trick and in [12] using the 
rigorous cavity method. For d < 1 and d — > 1~ we find a critical point for h = and /3 — > oo 
different from the usual Ising transitions. The limiting value for the free energy and for the 
overlap parameters has been obtained for p « N, i.e. in the limit N — > oo and p/N — > 0, 
so the capacity of the network defined as usual as a = Jr, goes to zero in the thermodynamic 
limit. The next step could be an expansion of the asymptotic free-energy for small a in a 
similar way as was done in |13j . 

The main results of the paper are the following two theorems: 

Theorem 1 Consider the Hopfield model with hi independent of and such that 

E{/if } < C . Then for any a > 0, if p — > oo 7 N — > oo, and p/N — > a, then the free energy 
/iV"(/3 ; H) is self averaging in the limit N — > oo 

E{\f N ((3,H)-E{f N ((3,H)}\ 2 } <C/N. (1.4) 

Here and below we denote by E{.} the averaging with respect to all random parameters of the 
problem. 

Remark 1 One can easily see from the proof of Theorem^ that Bernoulli {^f } can be replaced 
by i.i.d. with any distribution satisfying the conditions E{^} = 0, E{|^| 2 } = 1, and 

E {|£f| 4+e } < C- Moreover, the operators af,af of IO) can be replaced by any bounded 
operators. 

Theorem 2 Consider the Hopfield model M.ty) with hi = h£j . Then the mean free energy 
E{f^(j3, H)} satisfies the inequality 

\E{f N (p,H)}-minf Q (m,h)\ <Ca){ 3 , a N :=p/N (1.5) 

m 

where 

fo(m,h) = -^log2cosh/3((m + / l ) 2 + d 2 ) 1 / 2 + ^- (1.6) 
p 2 

is the free energy of the Curie- Weiss model (the Hopfield model with only one pattern). 
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Remark 2 Since the free energy is continuous function with respect to h, it follows from 
Theorem® that the statement of the theorem is valid also for h = 0. 

Remark 3 From the proof of Theorem® it will be seen that here also Bernoulli } can be 
replaced by i.i.d. with any distribution satisfying the same condition as in Remark{T\ 

But in this case the expression for fo(m, h) takes the form 

fo(m,h) = -^E{log2co S h/3(£i(m + hf + d 2 ) 1 / 2 } + ^. (1.7) 

Moreover, the matrices erf, erf of II 1.31) can be replaced by spin matrices of any dimension. But 
in this case the expression for fo(m,h) will be different from 111. 7\) . 

2 Proofs 

The proofs of Theorems [I] [2] are based on the method proposed in |14j . We start from the 
following general proposition: 

Proposition 1 Let H, H 1 be any hermitian 2 N x 2 N matrices, H(t) := H + tH 1 
f N (P,t) = --LlogTre-^W, Z N = Tre'^ 

and {ejt}? , are eigenvectors ofH(t), so that 

H(t)e k = E k e k , Hj k := (H 1 ^, ej), H 1 := H 1 - (H 1 ) H{t) . 

Then 



B 2 1 £L P -P E 3 - p-P E k 

■ W MM =— Y. I"]/ B _ R > o, P.i) 

k,j=l 



dt2 J«KH,"J- ZN ^^ jk \ Ek _ E , 
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d the Bogolyubov inequality \1J$ holds 



^- T {H l ) H {x) < f N W,l)-f N (P,0) < ^(#%(o)- (2.2) 



Proof. According to the Duhamel formula we have 

d 2 „ , ~ v p * 



dt 2 



NZn Jo ^ ' 



a 2N rl 1 2N --pE* p -pE k 

P V" irrl |2 / „-0E k T-8EJl-T)r _ 1 I rrl |2 



. v Y \H} k \ 2 [ e -^ k r- P E j{ l-r) dT = 1 V- |„1 | 

NZ N A^, Jkl J Z n/^i J E k -E j 



To prove (|2 . 2[) we observe that 

Integrating the last inequality with respect to i from to 1, we obtain (|2.2p . □ 
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. Then, using 

f£=o,/*=l,...,p 



Proof of Theorem[l\ Denote E<£ the averaging with respect to {£f }i<i<fc,i<^<p- Then, 
according to the standard martingal method (see |15j), we have 

n 

VarU^v^,^)} = ^E{|E< fc _ 1 {/ JV (/3,F)}-E< fc {/ iV (/3,F)}| 2 }. (2.3) 

k=l 

Denote E^ the averaging with respect to {£, k }i<fi<p and := H 
the Schwarz inequality, we obtain that 

|E< fc _!{M/3, H)} - E< fc {/jv(/3, H)}\ 2 = \B< k ^{f N ^, H) - B k {f N (f3, H)}\ 2 
< E< fe _i{|/7v(/3, H) - E k {f N {f3, H)}\ 2 } < E< k ^{\f N (f3,H) - f N ((3,H^)\ 2 }. 

Hence 

n 

Var{f N (J3, H)} < £ E{|/^(/3, H) - f N (J3, H^)\ 2 }. (2.4) 

k=l 

By the Bogolyubov inequality 

N 

r (fe). 



(Ah k a z k ) H + ^(fl J V°l°i) H < fNW, H) - f N (J3, F< 

3 = 1 

1 N 



3=1 

where Ah k = h k — h k . Hence 

N 

: . .. .. r / I 

E 



{\fN{fi^-fNifi,^)\ a }^{(^J^ai^y ^ (2.5) 

3=1 

1 ^ 2 

+ E {(^E J ^l) H }+ 4E ^}- 



Since does not depend on {^ k }l</j,<p, averaging with respect to {£, k }i<fi<p and using 

that 

E{JifcJjfc} = N' 1 Jij, 



we get 

N „ JV „ N -, N 



< E{||J||} 



E E {(^E J ^)^ (fe) } = E E {^ E ^(^h«(*)} - v 

fc=i j=i fc=i m=i 

For the second term in the r.h.s. of (|2.5p after summation with respect to A; we get 
N - N N.N 



E E {^ E JkiJ kj H^)H(^) H } < Ee{^ £ j fcl j fcJ (K)Vfa|)^} 
1 ^ 

E (A^*?)*} < 



fe=l «j=i fe=i «,i=i 

= E 



iV 

i J j,fc=i 
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Since it is well known that (see, e.g. [9]) 

E{||J 2 ||}<C, (2.6) 

the last two bounds combined with (|2.4p and (|2.5p prove Theorem [TJ □ 

Proof of Theorem To prove Theorem [2] let us introduce some additional Gaussian field 
to the Hamiltonian H 

p 

H(-f) = H + VNj2^ m ^ ( 2 - 7 ) 

where 

1 - 

4 = 1 

are so-called overlaps parameters and {7/x}^ = i are independent of and of each other 

Gaussian random variables with zero mean and variance 1. Using the Bogolyubov inequality 
(|2,2p and then the Schwarz inequality and (|2.6p . we get 



< E{f N (0, £T(7))} - B{f N (p, H)} 



p 

1/2 iV 

= ^ EV2 { E ^KW^Cr)} < (2-9) 

Consider also the "approximate" Hamiltonian of the form 

N P 

P N N /V P P 

= - N £ m W --£hi*l ~Y, d(J f + y E( cM ) 2 + ^E^- (2-10) 

/i=l i=l i=l M = l M = l 



Note that similarly to (|2.9p we have uniformly in c G 



E{/iv(/3,^a(7,c))}-E{/ iV (/3, J ff a (0,c))} < a]{ 2 C. (2.11) 



By the Bogolyubov inequality (|2.2p for any c € M p 

p 

2 



< f N (j3,H a (^,c)) - f N (f3,Hm < lj2((m» - c^) 2 )^. (2.12) 



Hence 



p 

Here and below we denote 



0< mm f N (P,H a (%c))- f N (j3,Hm < I ^T^) 2 )^. (2.13) 



m :=m> J ' - (m^H^y (2.14) 



Let {efc}^ =1 be the basis in which H(j) is diagonal and 



H(j)e k = E k e k , Mf k = (m^e k ,ej) 
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It is easy to see that 

v p 2 N 

£<(m" - {m»)f) H = f- E E l^l 2 ^"^ + e"^). 

/x=l ^=1 k ,j=l 

Using the inequality 

sinhx 

cosh 2; < h sinhx , 

x 

we can write 

P p 2 N 

E<(^ - (mn) 2 )H = ±- E E + ^ 

/u=l /i=l k,j=l 

1 p 2JV fo -PE, ~PE k 1 

<— y y |M^i 2 f e e + y^--e-^i 
= -E^^))+s, 

M=l 'A* 



where we have used that according to (12.1 



1 e -/9^ _ e -PE h g 



fej=i 



To estimate S, we use the Holder inequality, which yields 

-. P 2 N 

S: = ^"EE l^jilV^-e-^l 

/U=l fc J = l 

I P |p-/3Si _ p -/3E fc | 



/ 1 ^ ^ , „„| e -^_ e -^ hK2/3 



E E mi ! 



2^at ' J \Ek — Ej 



x ' ^ E E l^lV^ + e~^)\E k - E S 



1/3 



9 2 \2/3 m 

But it is easy to see that 

p 2 N 



Si: = ^EE \M^(e-^+e-^)\E k -E^ = -J2([^,H] 2 ) H 

p=l k,j=l ^=1 

P 1 N 2 Arft N 

E ((^E«?w.^i) ) H - £ E M"""') < « 2 
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On the other hand, averaging with respect to the Gaussian variables 7„, we obtain similarly 
to l|23) 



E { - E ^|^^^)} = E { -E^^fffy)} 

P p TV 

= - E {-^E^>*} < e 1/2 {^E4 e1/2 {^ E Moi)W} * cay*. 

The above inequalities combined with (12.13p . (12, 9p and (12, lip yield 



-Ca]l 2 < E{mmf N (P,H a (0,c))} -E{f N (J3,H)} < Cotf. 

In view of this bound it suffices to find E{min se ]Rp f(H a (0, c))}. By using the convexity of 
the function — log 2 cosh fiy/x in x for x > 0, we get for Cj = + ^2 £f c ^ 



/(iT a (0, c)) = - -L ^ log 2 cosh /3(C7 2 + d 2 ) 1 ' 2 + I 

p 1=1 11=1 

1 1 N 1 /2 1 P 

>-ilog2cosh/3(l^C7 2 + d 2 ) / +^( cM ) 2 

" i=l |U=1 

1 / P 

= - - log 2 cosh /?(V + /i) 2 + ^(c^) 2 + d 2 

P fi=2 

+ (A(c + he 1 ), (c + /^e 1 ))) 172 + 1 X> M ) 2 

> - - bg 2 cosh /?(y + /i) 2 + x>^) 2 + d 2 ) 1/2 + ^ X>^) 2 

(/» 2 + (c,c)). 



(2.15) 



2 

Here e 1 = (1, 0, . . . , 0) G K p , and the matrix ^4 is defined as 

A ^ = ±(i-6^)(e,n (2.i6) 

It is known (see e.g. [9]) that 

B{\\A\\ 2 }<Ca N . (2.17) 
Moreover, it is easy to see that if c is a minimum point, then 

= (mP)ir. => f>^) 2 = M°t)H a {v*) Ha < 

H=2 
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Hence (|2~T5j) and (JZU) imply 



E{mm/(r(0,c))} 



> mm { - - log 2 cosh p^c 1 + h) 2 + J>^) 2 + d 2 )^ + \ £(c") 2 } - 

, \ i \i/2 r 2 1 

> min < — — log 2 cosh /3( (r sin ip + /i) 2 + r 2 cos 2 <p + d 2 ) + — > — Cy/a^ 

r>0,0<ip<2ir I p V / 2 J 

> min { - \ log 2 cosh d((m + h) 2 + d 2 ) V2 + ^- j - CV«iV. (2.18) 

m>0 L p V / 2 J 

□ 

Let us now discuss briefly the equation for the point in which the r.h.s. of ([1.6p attains 
its minimum. It is easy to see that it has the form 

(m + h) tanh B ((m + h) 2 + d 2 ) 1/2 
m = ± '-jj- '- . 2.19 

{{m + hf + d 2 ) 1 ' 2 

For h = it takes the form 

1 /2 

m tanh 8 (m 2 + d 2 ) 
m = ^ T7T^- 2 - 20 

It is evident that it always has a solution m = 0. To find another solution we should study 
the equation 

(m 2 + d 2 ) 1/2 = tanh/3(m 2 + d 2 ) 1/2 . (2.21) 

This equation for d > 1 has no solutions because the r.h.s. is less than 1 and the l.h.s. is 
more than 1. For 8 < 1 the equation also has no solutions, since it is well known that the 
equation tanh Bx = x has no solutions except x = for 8 < 1. 

For d < 1 there is a critical point 8(d) such that for 8 > 8(d) (|2.20p has the unique 
solution m = and /3 > /3(d) there is also non zero solution of for (|2.20p . This critical value 
B(d) is a solution of the equation 

d = tanh Bd. (2.22) 

It is easy to see that 8(0) = 1 and 8(d) — > oo as d — > 1 (d < 1). One can see also that 
B'(d) > since it follows from (l2~22l) 



B'(d) = cT 1 cosh 2 /3d (l 



cosh Bd 



and the r.h.s. here is positive, since 2 - - is the derivative of the r.h.s. of (I2.22p with 



A 

cosh 2 Bd 

respect to d, and at the solution point of (I2.22P this derivative is less than 1. Moreover, since 
tanh(8d) ~ 1 - e" 2/3d for Bd -> oo, we have from (|2.22p that 



2/3ci 



1 



(1-d)" 1 => /3(d) ~ -log(l -d)-\ d^l. 
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